Using Bad Learners to find Good Configurations

Finding the optimally performing configuration of a software system for a given setting is often challenging. Recent approaches address this challenge by learning performance models based on a sample set of configurations. However, building an accurate performance model can be very expensive (and is often infeasible in practice). The central insight of this paper is that exact performance values (e.g. the response time of a software system) are not required to rank configurations and to identify the optimal one. As shown by our experiments, models that are cheap to learn but inaccurate (with respect to the difference between actual and predicted performance) can still be used rank configurations and hence find the optimal configuration. This novel \emph{rank-based approach} allows us to significantly reduce the cost (in terms of number of measurements of sample configuration) as well as the time required to build models. We evaluate our approach with 21 scenarios based on 9 software systems and demonstrate that our approach is beneficial in 16 scenarios; for the remaining 5 scenarios, an accurate model can be built by using very few samples anyway, without the need for a rank-based approach.Comment: 11 pages, 11 figure

A versatile characterization of poly(N-isopropylacrylamideco- N,N'-methylene-bis-acrylamide) hydrogels for composition, mechanical strength, and rheology

Poly(N-isopropylacrylamide-co-N,N"-methylene-bisacrylamide) (P(NIPAAm-co-MBA)) hydrogels were prepared in water using redox initiator. The copolymer composition at high conversion (> 95%) was determined indirectly by HPLC (high performance liquid chromatography) analysis of the leaching water and directly by solid state 13C CP MAS NMR (cross polarization magic angle spinning nuclear magnetic resonance) spectroscopy of the dried gels, and was found to be close to that of the feed. The effect of cross-linker (MBA) content in the copolymer was investigated in the concentration range of 1.1–9.1 mol% (R:90–10; R = mol NIPAAm/mol MBA) on the rheological behaviour and mechanical strength of the hydrogels. Both storage and loss modulus decreased with decreasing cross-linker content as revealed by dynamic rheometry. Gels R70 and R90 with very low cross-linker content (1.2–1.5 mol% MBA) have a very loose network structure, which is significantly different from those with higher cross-linker content manifesting in higher difference in storage modulus. The temperature dependence of the damping factor served the most accurate determination of the volume phase transition temperature, which was not affected by the cross-link density in the investigated range of MBA concentration. Gel R10 with highest cross-linker content (9.1 mol% MBA) behaves anomalously due to heterogeneity and the hindered conformation of the side chains of PNIPAAm

Neuropsychological profiles and behavioral ratings in ADHD overlap only in the dimension of syndrome severity

Objectives. The aim of this study was to compare the cognitive neuropsychological and the behavioral rating profiles of attention deficit/hyperactivity disorder (ADHD). Methods. Forty-two children diagnosed with ADHD (M=11.5  years, SD=1.1) and 43 typically developing children (M=11.2 years, SD=1.7) participated. We measured symptom severity with behavioral rating scales, and we administered neuropsychological tasks to measure inhibitory performance, updating/working memory, and shifting ability. Results. On the basis of the three neuropsychological variables, the hierarchical cluster analytic method yielded a six-cluster structure. The clusters, according to the severity of the impairment, were labeled as follows: none or few symptoms, Moderate inhibition and mild shifting, moderate to severe shifting with moderate updating, moderate updating, severe updating with mild shifting, and severe updating with severe shifting. There were no systematic differences in inattention and hyperactive-impulsive behavior across the clusters. The comorbid learning disorder appeared more likely only in severe neuropsychological forms of ADHD. Conclusion. In sum, our results suggest that behavioral ratings and neuropsychological profiles converge only in the dimension of symptom severity and that atypicalities in executive functions may manifest in nonspecific everyday problems

Optic radiation structure and anatomy in the normally developing brain determined using diffusion MRI and tractography

The optic radiation (OR) is a component of the visual system known to be myelin mature very early in life. Diffusion tensor imaging (DTI) and its unique ability to reconstruct the OR in vivo were used to study structural maturation through analysis of DTI metrics in a cohort of 90 children aged 5–18 years. As the OR is at risk of damage during epilepsy surgery, we measured its position relative to characteristic anatomical landmarks. Anatomical distances, DTI metrics and volume of the OR were investigated for age, gender and hemisphere effects. We observed changes in DTI metrics with age comparable to known trajectories in other white matter tracts. Left lateralization of DTI metrics was observed that showed a gender effect in lateralization. Sexual dimorphism of DTI metrics in the right hemisphere was also found. With respect to OR dimensions, volume was shown to be right lateralised and sexual dimorphism demonstrated for the extent of the left OR. The anatomical results presented for the OR have potentially important applications for neurosurgical planning

An Investigation into the Use of Mutation Analysis for Automated Program Repair

Research in Search-Based Automated Program Repair has demonstrated promising results, but has nevertheless been largely confined to small, single-edit patches using a limited set of mutation operators. Tackling a broader spectrum of bugs will require multiple edits and a larger set of operators, leading to a combinatorial explosion of the search space. This motivates the need for more efficient search techniques. We propose to use the test case results of candidate patches to localise suitable fix locations. We analysed the test suite results of single-edit patches, generated from a random walk across 28 bugs in 6 programs. Based on the findings of this analysis, we propose a number of mutation-based fault localisation techniques, which we subsequently evaluate by measuring how accurately they locate the statements at which the search was able to generate a solution. After demonstrating that these techniques fail to result in a significant improvement, we discuss why this may be the case, despite the successes of mutation-based fault localisation in previous studies

A rigorous evaluation of crossover and mutation in genetic programming

The role of crossover and mutation in Genetic Programming (GP) has been the subject of much debate since the emergence of the field. In this paper, we contribute new empirical evidence to this argument using a rigorous and principled experimental method applied to six problems common in the GP literature. The approach tunes the algorithm parameters to enable a fair and objective comparison of two different GP algorithms, the first using a combination of crossover and reproduction, and secondly using a combination of mutation and reproduction. We find that crossover does not significantly outperform mutation on most of the problems examined. In addition, we demonstrate that the use of a straightforward Design of Experiments methodology is effective at tuning GP algorithm parameters

Mapping degeneration of the visual system in long-term follow-up after childhood hemispherectomy - A series of four cases

OBJECTIVE: Although hemidisconnection surgery may eliminate or reduce seizure activity in patients with epilepsy, there are visual, cognitive and motor deficits which affect patients' function post-operatively, with varying severity and according to pathology. Consequently, there is a need to map microstructural changes over long time periods and develop/apply methods that work with legacy data. METHODS: In this study, we applied the novel single shell 3-Tissue method to data from a cohort of 4 patients who were scanned 20-years following childhood hemidisconnection surgery and presented with variable clinical outcomes. We have successfully reconstructed tractography of the whole visual pathway from single shell diffusion data with reduced number of gradient directions. RESULTS: All patients presented with degeneration of the visual system characterised by low fractional anisotropy and high mean diffusivity. There were no apparent microstructural differences between both optic nerves that could explain the different level of visual function across patients. However, we provide evidence suggesting an association between the level of visual function and DTI metrics within the remaining components of the visual system, particularly the optic tract, of the contralateral hemisphere post-surgery. SIGNIFICANCE: We believe this study suggests that diffusion MRI can be used to monitor the integrity of the visual system following hemispherectomy and if extended to larger cohorts and a greater number of time-points, including pre-surgically, can provide a clearer picture of the natural history of visual system degeneration. This knowledge may in turn help to identify patients at greatest risk of poor visual outcomes that might benefit from rehabilitation therapies

Visual Function Twenty Years After Childhood Hemispherectomy for Intractable Epilepsy

PURPOSE: To investigate visual function in adults post hemispherectomy in childhood. DESIGN: Non-comparative case series. METHODS: All participants underwent visual acuity, binocular function, visual field, optical coherence tomography (OCT) of the retinal nerve fiber layer (RNFL), and monocular pattern reversal visually evoked potentials (prVEP). PARTICIPANTS: 6 adults who had a hemispherectomy in childhood (median 21.5 years post-op). MAIN OUTCOME MEASURES: Comparison was made of visual acuity, visual field height, global RNFL thickness and prVEP amplitude evoked by full and half field stimulation. Comparison of the eye ipsilateral to the side of surgery to the contralateral eye was achieved employing paired t-tests to the visual function measures. RESULTS: All participants had homonymous hemianopia. The residual seeing visual field was constricted in all cases when compared to normative data despite crossing the midline into the blind hemi field in 11/12 eyes. This observation was supported by prVEP's to stimuli presented in the blind half field. The height of visual field was smaller in the eye contralateral to side of surgery compared to the ipsilateral side (P=0.047). Visual acuity and RNFL thickness also showed greater diminution in the eye contralateral (P=0.040 and P=0.0004). Divergent strabismus was in four participants with greater field loss. CONCLUSIONS: Adults post hemispherectomy in childhood may have better visual function in the eye ipsilateral to the side of the hemispherectomy compared to the contralateral eye. Possible mechanisms of the inter-ocular difference are discussed. Though visual fields and prVEP responses demonstrate evidence of re-organization in to the blind half field, they also reveal significant un-expected constriction of the functional field

Automated multi-objective calibration of biological agent-based simulations

Computational agent-based simulation (ABS) is increasingly used to complement laboratory techniques in advancing our understanding of biological systems. Calibration, the identification of parameter values that align simulation with biological behaviours, becomes challenging as increasingly complex biological domains are simulated. Complex domains cannot be characterized by single metrics alone, rendering simulation calibration a fundamentally multi-metric optimization problem that typical calibration techniques cannot handle. Yet calibration is an essential activity in simulation-based science; the baseline calibration forms a control for subsequent experimentation and hence is fundamental in the interpretation of results. Here, we develop and showcase a method, built around multi-objective optimization, for calibrating ABSs against complex target behaviours requiring several metrics (termed objectives) to characterize. Multi-objective calibration (MOC) delivers those sets of parameter values representing optimal trade-offs in simulation performance against each metric, in the form of a Pareto front. We use MOC to calibrate a well-understood immunological simulation against both established a priori and previously unestablished target behaviours. Furthermore, we show that simulation-borne conclusions are broadly, but not entirely, robust to adopting baseline parameter values from different extremes of the Pareto front, highlighting the importance of MOC's identification of numerous calibration solutions. We devise a method for detecting overfitting in a multi-objective context, not previously possible, used to save computational effort by terminating MOC when no improved solutions will be found. MOC can significantly impact biological simulation, adding rigour to and speeding up an otherwise time-consuming calibration process and highlighting inappropriate biological capture by simulations that cannot be well calibrated. As such, it produces more accurate simulations that generate more informative biological predictions